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INTRODUCTORY STATEMENT 



The Center for Social Organization of Schools has two primary 
objectives: to develop a scientific knowledge of how schools affect 
their students, and to use this knowledge to develop better school 
practices and organization. 

The Center works through five programs to achieve its objectives. 

The Academic Games program has developed simulation games for use in 
the classroom, and is studying the processes through which games teach 
and evaluating the effects of games on student learning. The Social 
Accounts program is examining how a student's education affects his actual 
occupational at tainment , and how education results in different vocational 
outcomes for blacks and whites. The Talents and Competencies program is 
studying the effects of educational experience on a wide range of human 
talents, competencies, and personal dispositions in order to formulate-- 
and research- -important educational goals other than traditional academic 
achievement. The School Organization program is currently concerned 
with the effects of student participation in social and educational 
decision-making, the structure of competition and cooperation, formal 
reward systems, ability-grouping in schools, and effects of school 
quality. The Careers and Curricula program bases its work upon a theory 
of career development. It has developed a self-administered vocational 
guidance device to promote vocational development and to foster satisfying 
curricular decisions for high School, college, and adult populations. 

This report, like others occasionally published by the Center, 
deals with a subject common to all programs — that of scientific 
measurement. 
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ABSTRACT 



The formula for correcting coefficients of partial correlation 
for attenuation due to errors of measurement is derived . In addition, 
the correction for attenuation formulas for multiple and canonical 
correlations are presented and discussed. The attenuating effects of 
measurement error are examined algebraically for a special case of 
partial correlation and by means of numerical examples for the general 
case of partial correlation arv’ multiple correlation. Finally, the 
formula for the corrected partial r is related to recent work on the 
measurement of change. 




iv 



6 



Introduction 



In dealing with multivariate correlational techniques and fallible 
data, one is faced with the same difficulties that have been pointed out 
for the product-moment correlation (Finucci, 1971) and other similar 
measures of association (Stanley, 1971) . Correlations based on rallibly 
measured variables will result in values which are underestimates of the 
correlations among the true parts of the variables, (The truth of this 
statement for all multivariate situations has not been proven analytically, 
but Cochran's (1970) work regarding multiple correlation suggests that the 
statement does, in fact, hold true.) Investigators have been inclined to 
ignore the problems of unreliability, being content with underestimates of 
the true relationship and avoiding Questionable' 1 correction for attenua- 
tion procedures. However, such an approach ignores useful information. 

In addition to providing a means for obtaining estimates of true-score 
correlations, correction for attenuation formulas facilitate understanding 
of the effects of unreliability on the results. Information of this type 
is useful, for example, in deciding how much could be gained by expending 
time and money to develop more reliable measurement. 



The purpose of the present paper is to give the correction for attenua- 
tion formulae for partial, multiple, and canonical correlation coefficients 
and to discuss, where known, the effects of measurement error on these sta- 
tistics. Most of the formulas presented have been derived elsewhere in the 
literature. I have simply standardized the notation and extended some of 
the derivation where appropriate. 

Partial Correlation Corrected for Attenuation 
First, consider the jrirst-order partial correlation coefficient. Sup- 
pose there are three fallibly measured variables x^, x^, and x^ of, say, 
alienation, school achievement, and I.Q. and one wants to know the true cor- 
relation between alienation and school achievement, controlling for I.Q. 

Begin by defining the variable x^ to be the sum of its true score, t^, and 
errors of measurement, (x^ - t^ 4* e^ for i = 1, 2, 3). (In the sequel it 
is assumed that E(x^) = 0-) We assume that the true score and error for each 

variable covary zero ((7^. - 0) ; that the true score of one variable and 

i i 

the error component in another variable covary zero ( = 0); and that 

C i e j 

the errors in the differential variables covary zero (y— = 0) . 

e i 6 j 

The partial correlation between alienation and achievement, controlling 
for I.Q., is defined as the zero-order correlation of residuals. The resi- 
duals for alienation are given by the difference between the observed values 
and the regression estimates of alienation from I.Q. The residuals are 
represented symbolically in equations (1) and (2). It is well known that 



’ ^ = x, - S x~ 


(1) 


1.3 1 X X 3 

J. J 




_ «■ x„ - B x_ 


(2) 


2.3 2 X 2 X 3 ^ 
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the correlation of 
order correlations 



VV X 3 



residuals can be expressed in terms of the three zero- 
. The formula is given in (3) , which is the partial r 



X 1.3 X 2.3 



1.3 



2 , 3 



P “ P P 
X 1 X 2 X 1 X 3 X 2 X 3 

^(i - p 2 )d - p 2 ) 

X 1 X 3 X 2 X 3 



(3) 



based on fallible measures. The partial correlation coefficient, corrected 
for attenuation, would yield the partial correlation of true score, i.e., 
the correlation of true score residuals. We can obtain the correction for 
attenuation formula by starting with the correlation of true score residuals 
and working backwards. 



The true score residuals are defined as the difference between the true 
value and the estimated true value based on a regression of the variable 
(t^ or t^) on the true value of the control variable (t^) and are given in 
formulas (4) and (5). The partial correlation of t^ and t^ controlling for t^ 



C l. 3 = t l 3t 1 t 3 t3 

t 2.3 " 4 " 6 t 2 t 3 t 3 



( 4 ) 

(5) 



is then given by (6) • Expanding numerator and denominator, we can use some 

a , 



t l. 3 t 2.3 



(t l " 3 t lt3 t 3 )<t 2 - 3 t 2 t 3 t 3 ) 



tlt2 ‘ t3 D- I 2 n. 2 

Al.3 4.3 



(6) 



t 3 ) 



'13 3 

of the well-known properties of classical test theory to express the true 

partial correlation in terms of the attenuated zero-order correlations 

.and reliabilities. The result, given in (7) is the correction for attenuation 

PonP " P P 
33 x^x 2 x i x 3 X 2 X 3 



y|u p 33 - V 2 )/(°22 C 33 " “v] 
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(7) 



formula for a first-order partial correlation. (The proof is given in 
the appendix.) It should be noted that the formula is equivalent to cor- 
recting each of the zero-order correlations for attenuation by the usual 
way and substituting these values into (3). (See Livingston and Stanley, 

1970.) 

A General Approach to Multivariate Corrections for Attenuation 

Meredith (1964) developed a more general approach to correction for j 
attenuation problems which he has applied to the canonical correlation problem. 
His result can be readily applied to problems involving partial and multiple 
correlation. We begin with a variance-covariance matrix, 22^, of rank p 4- q, 
where p + q is the number of variables. Under the assumption that the clas- 
sical test theory model is appropriate for each of the p 4- q variables we 

can write the matrix as the sum of two matrices, 21 , the variance-co- 

x 9 t 

variance matrix among true scores, and the variance-covariance matrix 

among the errors of measurement (equation 8). 



is a diagonal matrix of the variance errors of estimates. We can obtain 
22 t by subtraction (equation 9). Given the matrix of true 



score variances and covariances, it is a simple matter to obtain the ma- 
trix of true score correlations by dividing each element by the square 
root of the product of the appropriate variances* These operations are 
shown in matrix notation in equation (10). 





( 9 ) 



^ = dc r x r % £ r D (x r )‘ % 



( 10 ) 
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It is important to note here that (10) is equivalent to correcting 

each of the zero-order correlations in R , the matrix of observed corre- 

x 

lations, for attenuation in the usual manner. That such is the case 

becomes clear if we consider each of the p 4- q variables to have a mean 

of 0 and a variance of 1. Under the latter condition 5* 1 = R and 

^x x 

Yl e is a diagonal matrix of alienation coefficients. Thus, the matrix 
of (9) is the matrix of observed intercorrelations (R^) with relia- 
bilities on the diagonal, which is the true-score variance-covariance 
matrix of standardized variables. The operations shown in (10) now in- 
volve dividing every correlation in R^ by the square root of the product 
of the reliabilities for the appropriate variables, which is the zero- 
order correction for attenuation procedure. 



So far, the discussion has been in terms of population values. Mere- 
dith has pointed out that a maximum likelihood estimate of and thus of 

A 

R^ can be obtained from 2 , the sample variance-covariance matrix, if the 
t x 

reliabilities of the measures are kncwn (equations 11 and 12) . Though the 
remainder of the paper continues to use the population values, one can 

A 

easily substitute under the above restriction. 



A 





A 




d(£ t >" 1/2 £ t d(£ t )~ 1/2 



(11) 

( 12 ) 



A general procedure for correcting multivariate correlations for atten- 
uation involves the following two steps. Firs t , correct each of the zero- 
order correlations for attenuation in the usual way to obtain R . Second , 
calculate the desired statistic from R t * 
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Let us return to the problem of partial correlations. Suppose that we 
were interested in obtaining the true score correlations among a set of p 
variates controlling for true scores on a second set of q variables. We 
could solve the problem by first obtaining R fc , partitioning as shown 
in (13), and using the matrix solution for partial correlations (Anderson, 



R r = 



r t ‘ r t 
hi i L i2 



R„ 



'21 



I R , 
I 



•22 



R T = r t 

i 1.2 i ll 



-1 

12 T 22 X 21 



r t, r t™ r t 



(13) 

(14) 



1958:29 and Morrison, 1967:89) shown in (14) above. If q - 1, R is 

T 1.2 

a p x p matrix of first order partials whose off-diagonal elements are 
of the form given in (3) . 



The multiple correlation problem involves finding the maximum corre- 
lation between a single criterion and a linear combination of, say, p 

2 

predictors. The matrix solution for squared multiple correlation (MR ) 

o 

is given in (15) (See Anderson, 1958: 30, or Morrison, 1967:104). The MR 
between the true scores of the p predictors and the criterion could be 

MR l = Ry R^ 1 Ry (15) 

x x 21 x n x 12 

obtained by substituting the corresponding true score correlation matrices 

of (13) into (15), resulting in equation (16). (R and R are vectors.) 

2 1 21 12 
MR = R rI R (16) 

21 ^11 1 12 , 

r 

In the above situation, any of the p + 1 variables could be designated 



as the criterion by simply interchanging the appropriate rows and columns 



of R . A general formula for of each of the i variates with the remain- 

Z i 

ing variates corrected for attenuation is given by (17), where I is a p + 1 
identity matrix and D indicates diagonals of the matrices given in paren- 
theses . 

2 " 1-1 

) - I - D(P t ) (17) 

i 

The last statistic we shall discuss is the canonical correlation co- 
efficient (Hotelling, 1936)* Canonical correlation is a generalization of 
the concept of multiple correlation to the case of multiple criteria (q > 1) 
as well as multiple predictors (p > 1). The objective in such an analysis 
is to find the maximum correlation between a linear composite of the predic- 
tors and a linear composite of the criteria. Though Hotelling was primarily 
concerned with the largest correlation between these composites, there are 
k = min (p, q) possible independent correlations. The k canonical corre- 
lations for any given set of p predictors and q criteria are given by the 
latent roots of ^21^11^12^22" M ere dith (1964) has shown that if the true- 
score correlation matrix in (13) is used, you would have the k canonical 
correlations corrected for attenuation. The weighting vectors to form the 
linear composite of the criterion variates and the linear composite of 

predictor variables are the latent vectors of R 2i R ii R i2 R 22 and R 12 R 22 R 21 R 11 ' 
The formulas would provide either the attenuated weighting vectors or the 
true-score weights, depending on which correlation matrices were used. 
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Effects of Errors of Measurement 



In the introduction it was pointed out that the most well-known effect 
of errors of measurement on zero-order correlations is to produce an under- 
estimate of the true value. This appears to also be the case for multiple 
correlation. For example, Cochran (1970) showed that for a number of situa- 
tions involving multiple correlation, a good estimate of attenuating effects 



of fallible data is given by (18) . Though the actual value of MR^ may run 



25X higher than this value for posit 



itivey<?^ and low predictor reliability 






it never exceeds 



MR^. 



2 2 

MR X = MR t . • P 



l-l" 1 ^ 11 . R 2 - 

qq q-1 " T P qq P ii 



£ p 

i=*l 



iq 



(18) 



where p is reliability of the criterion 

qq 7 

P i;L is reliability of the ith predictor 



Piq is correlation between criterion and ith predictor, 



Bohrnstedt (1969) derived a formula for correcting partial correlations 
for attenuation due to errors of measurement which is similar to (7), but 
does not contain the terms fill' ^P on exam i n i n g bis derivation, it was 
apparent that he was correcting only for errors of measurement in the con- 
trol variable x^ . In effect, he had provided the formula for a partially 
corrected partial correlation coefficient* On the basis of his formula, 
Borhnstedt indicates that it is possible for the corrected partial correla- 
tion to be less than the obtained partial correlation* While this appears 
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to be the case the author’s verbal argument is misleading. He points out 
that in his formula, given in (19), the factor p. ^ in the numerator would 






f^2>2> /x 4 x 2 /x 



2 X 3 



(19) 



i 3 



33 /x 2 x 3 



tend to make (19) smaller than (3). (Bohrnstedt, 1969:127). He does not 
mention that the presence of /33 in the deonominator of (19) would tend to 
make (19) larger than (3). The net effect of these two factors is not ob- 
vious, By making the simplifying assumption that (which is not 

very restrictive) , we can show algebraically that (19) will always be less 
than (3). Assuming the correlations with the control variable to be equal, 

2 

v 3 



(3) and (19) reduce to 

^ x l x 2 ~ fil x 3 

^ X 1 X 2. X 3 ~ (1 



/ < X 1 X 2. 1 



fx^x.2 ~ /x > 1 x 3 / /^33 

Cl _/Px l X 3 1 PJ 



O’) 



(19’) 



Letting the quantities in (3 1 ) be represented by a - b 0 and the quan- 

2 a - b > 

tities in ( 19 1 ) by yz , it is sufficient to show that 



(1 - d") : 



G = 



a - b 



a - d 



> 0 



1 - b 1 - d 
Creating a common denominator for G one secures: 



_ (1 - d 2 )(a - b 2 ) - (1 - b 2 )(a - d 2 ) 

2 2 
(1 - b ) (1 - d Z ) 

Since the denominator will always be positive, it is sufficient to show that 

■ 2222 2222 
G = (a - ad - b + d b ) - (a - ab - d + b d ) > 0 
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Simplifying the above expression yeilds 



G* = (d 2 - b 2 ) - a (d 2 - b 2 ) . 

The value d represents the zero order correlation between variables 

1 and 3 corrected for errors of measurement in and b represents the 

attenuated correlation. It is well known that d>b. Thus, since |a|<l, 

it is true that G > 0 which completes the proof that D ~>Pv v t 

Q / X 1 X 2. 3 7 X 1 X 2- C 3 

The proof of this latter inequality when f ^*3 x 2*3 becomes algebraically 

intractable. However, one effect of correcting for attenuation due to a 
fallible x^ only, is to decrease the size of the residuals being correlated 
in (19) . It is well known that a restriction in the range of a variable 
decreases correlations involving the variable. As Bohrnstedt points out, 

" the smaller the residual variation to correlate, the smaller the partial 
correlation (127) 

Blalock (1964: 149-150) has noted that it is possible to observe a 
non-zero partial correlation when the true relationship is zero, due to 
errors of measurement in the control variable. That such is the case 
is clear only when/^ = yP = 1 and thus (19) is the true partial correla- 
tion. However, when all three variates are fallibly measured, the size of the 
observed partial relative to the true partial is difficult to determine 
algebraically. The information presented in Table 1 does provide some infor- 
mation on their relative values for a range of reliabilities and correlations. 
In order to simplify computation and presentation it was assumed thaty^ ^ = fl2 

and P = P . Out of the ten true partial correlations possible in 
' X 1 X 3 / X 2 X 3 

Table 1, three of them were less than the attenuated partial r. One of 



10 





TABLE 1 



Comparison 
Different Values 



of 77 . . and for 

Va-S y W x 3 

of /ll*/^ 22’/^ 33 , / / 7 x 1 x 2 ’ / /^ 1 x 3 ’ 



And /? 

/ x 2 x 3 



RELIABILITIES 

( /33 ’Z 7 22’Zil ) 


( • 2 > *2, #3) 


CORRELATIONS 
(.5, .5, .3) (.2, 


) 

.2, .7) 


(.5, .5, .7) 


(.6, .6, .7) 


(.3, .4, .4) 


* 

.63 


** 


** 


rt* 


VrjV 


(.9, .4, .4) 


.72 


• 18 


** 


** 




(.3, .8, .8) 


. . 25 I 


vV* 


.86 




VcVf 


(•9, .8, .8) 


.34 


' .04+ 


. .87 


.81 .50 t 


x 1 x 2» x 3 * 


.27 


.07 


.69 


.60 


.53 



* Numbers in the Table are 



/?it 2 .t 3 

** Impossible because p , > 

' t l t 2* 3 * 

-J- True value is less than the attenuated value. 
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these occurred in the cell where the reliability of the control variable 
was small (-30) and the reliability of the other variables was large (.80). 
The other two cases occurred in cells where all reliabilities were high 
(.90, .80) and the correlations with the control variablevere large (.60). 
The data in Table 1 suggest that when all three variables are fallibly 
measured, the attenuated partial r will more often be an underestimate of 
the true value than an overestimate and that the underestimation is more 
severe than the overestimation. These tentative conclusions of course need 
to be verified by more extensive monte carlo simulations over a wider range 
of values. 



It may be useful at this point to relate equation (7) to recent work 
on the measurement of change by Tucker, Damarin, and Messick (1966) and 
Cronback and Furby (1970) (hereafter referred to as TDM and CF, respectively). 
Of primary interest in these papers is the definition of a "true" residual 
change score. The trwo equations, in a form consistent with this* paper, are 



A 

t 



1.3 



= x, 



A.t 



13 



( 20 ) 

(TDM's Equation 25) 



t l 3 *“ t i t t 3 

13 (CF 1 s Equation 22) 

(Where x^ and x^ are the pretest and posttest measures, respectively.) The 
formula for residual in (20) by TDM is similar to Bohrnstedt's work in that 
it only takes into account the reliability of the pretest (control) variable. 
The equation in (20) used by CF is identical to (4) . Both papers propose the 
use of the residual change score for correlation with other variables (TDM, 

A 

1966: 470 and CF, 1970: 76). The resulting part correlations of either q 

! i- . O 




12 
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or t l 3 wit ^ x 2 are attenuateci by the fallible X£, since i Q not taken 
into account. 

A second problem raised when errors of measurement are present is the 
valid interpretation of results for multivariate correlations. In multiple 
and canonical correlation studies, an important objective is to discover 
the relative importance of the predictor and criterion variables. The inter- 
correlations among these variables and their unreliability can interact to 
produce misleading results. An example from Cochran (1970:33) illus- 
trates this point. 

A common practice in the application of multiple correlation (especially 

2 

among sociologists) is to partition the predicted variance MR into por- 
tions uniquely attributable to each predictor and the portion of common 
variance predicted. Unreliability can have a substantial effect on the 
results of such an analysis. Consider the 2-predictor case with = 

A 3 = °- 5 ’ and /i 2 =0.3 and no error of measurement: 

2 

MR 3 ^ - .385 % of variance unique to x^ = 13.5 

7o of variance unique to x^ = 13.5 
7o of variance common to both = 11.5 
2 

(Uniqueness of x 1 is here defined as the drop in MR that would result 

Darlington (1968: 162) defines this 
It is clear in the above example that 
— .135, the uniqueness for x^.) 



13 



from deleting x^ from the equation, 
as the "usefulness" of a variable. 

MR 3 . 2 = P 23 = ,25, MR 3.12 " m 3.2 



O 
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With the reliability of variable 
1 equal to ,3; i.e. = 

a " d /22 = 



^ 3 .12 -356 



With /»! - 0. 
m 3.12 ‘ ’ 328 



6 and ^^2 ~ 1 



1 


of 


variance 


unique 


to 


X 1 = 


10.6 


1 


of 


variance 


unique 


to 


X 2 = 


15.6 




of 


variance 


common 


to 


both 


= 9.4 



of 


variance 


unique 


to 


x i = 


7.8 


of 


variance 


unique 


to 


i 

X 2 = 


17.8 


of 


variance 


common 


to 


both 


= 7.2 



In the above example we see that as the reliabilities of the pre- 
dictors become more disparate, the true contribution of each variable 
becomes more distorted. This effect can be best understood when one con- 
siders what would happen if were removed from the correlation, alto- 
2 

gether. MR Q 9 would equal .25 and the percent of variance unique to x ? 

o # z z 

would be 25. Unreliability in one of the variables takes part of that 
variable n out M of the prediction, shifting predicted variance to the more 
reliable predictors. The change in the importance of predictors in mul- 
tiple correlation caused by deletion of one of the variables has been 
referred to as the "bouncing betas." It is apparent from these examples 
that differences in the reliabilities adds more bounce to these results. 
These results on the effects of disparate reliabilities are one more 
reason to heed the warning given by Darlington, "It would be better to 
simply concede that the notion of 'independent contribution to variance' 
has no meaning when predictor variables are intercorrelated. " (1968:169) 
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-A. 



APPENDIX 



Derivation of correction formula for partial correlation coefficient. 



C i.3 C 2.-J 



(t. - B r t )(t - S r t ) 

1 V3 3 2 C 2 C 3 3 



t l t 2' t 3 



^1.3 • \ 3 i - e t 1 t 3 t 3>°< t 2 - V 3 t3> 



Expanding the numerator of ( 1) 



( 1 ) 



*■ 1 . 3 C 2 . 3 c i4 ' t 'l t 3~ t 2 t 3 V 3 V 3 " VjVVs 

I n \ I 



(1 



- (3 _ f> _ + B 6 cT 



o. a p 

C 1 C 2 V 2 



p t _ lo a p 

1 3°t 3 | C 2 C 3 t 2 t 3 



a \ 

i -I* 
Wt. 
J / 



a a p 

C 1 c 3 C l t 3 



+ P 






V 3 °t 



3/ 



a 

, C 2 2 

p a 

t 2 C 3°c 3 l 3 



(The last two terms are equivalent except for sign, and thus they sum to zero.) 

« a o - p cf a 4 

C 1 l 2 t l C 2 t l C 3 C 1 l 2 l 2 l 3 



X 1 X 2 



X 1 X 3 



S /° 11^22° x.°x 9 f r- — 

/ 1 yP u P 22 ^33 



X 2 X 3 



Piip22 V x k3 



22 33 



Therefore, where is the reliability coefficient of variable 



) -a a 

VbVb X 1 x 2 



n - p p 

33 x^x 2 x i x 3 x 2 X 3 



P 



33 



Expanding the first term in the denominator of (lJ one secures 

o 2 - o 2 + B 2 D 2 - 2B o 
C 1 . 3 V C l t 3 C 3 C 1 C 3 C 1 L 3 

2 2 2 2 

- o + p o - 2p u P„ „ 

C 1 V 3 c l C l t 3 h t l t 3 

2 2 2 , 

= 0 - p o 

tj V 3 t 3 



( 2 ) 



O 

ERIC 



2 2 
P p, ,o 

o 2 X 1 X 3 11 X 1 

P H x 3 p n p 33 
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Therefore , 



a = a 
* 1,3 X 1 



, [ P 11 P 33 P x 1 x 3 



33 



Similarly, it can be shown that 

( P 22 P 33 - P x 2 x 3 ) 



‘2.3 *2 



'33 



Substituting ( 2 ), ( 3 ), and <4 ) into ( 1 ) and simplifying we get 



p 33 P X;L x 2 " %x 3 p x 2 x 3 



t l t 2 , . t 3 



^ P 11 P 33 ” P x 1 x i )/( P 22 P 33 P x 2 x 3 ] 



( 3 ) 



(4) 



which is the formula for the partial correlation coefficient 
corrected for attenuation# 
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